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FOREWORD 


As  part  of  the  on-going  research  program  in  “Decision  Control 
Models  In  Operations  Research",  the  authors  of  this  report  have 
Investigated  several  methods  of  forecasting  the  performance  of 
statistically-controlled  Inventory  systems.  This  work  Is  an  attempt 
to  Improve  upon  the  bias  and  variability  of  the  method  of  retro- 
spective simulation  which  was  Investigated  In  previous  studies 
(see  Technical  Report  Nos.  2,  3,  and  7).  Although  the  authors  report 
only  partial  success,  several  new  avenues  of  research  have  emerged. 
These  will  be  discussed  In  subsequent  Technical  Reports. 

A list  of  other  related  reports  dealing  with  this  research  program 
follows. 
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Harvey  M.  Wagner 
Principal  Investigator 


Richard  Ehrhardt 
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ABSTRACT 


We  consider  the  management  of  an  inventory  control  system  operating 
under  incomplete  information  about  the  probability  distribution  of  demand. 
The  system  control  policy  is  of  an  (s,S)  form  where  the  policy  parameters, 
s and  S,  are  periodically  revised  using  a demand  history  of  fixed  length. 

In  such  a system  it  is  often  desirable  to  forecast  values  of  such  key 
system  operating  characteristics  as:  total  cost  per  period,  period-end 
inventory,  period-end  backlog  quantity,  backlog  frequency,  and  replenish- 
ment frequency. 

Several  methods  of  forecasting  system  performance  are  presented.  The 
criterion  used  to  evaluate  and  compare  these  methods  is  the  extent  of 
prediction  bias  and  its  level  of  dispersion.  Most  of  these  procedures 
require  estimation  of  the  underlying  demand  distribution  from  a limited 
sample  of  historical  data.  We  have  found  for  our  16-item  system,  that 
forecasts  of  aggregate  total  cost  are  typically  20%  below  actual  values. 
Much  of  this  error  results  from  underestimation  of  backlog  quantities. 

This  is  due  to  the  fact  that  the  demand  data  is  used  both  to  set  the  policy 
parameters  and  to  forecast  system  behavior. 


1.  OPERATING  CHARACTERISTICS  OF  (s,S)  INVENTORY  SYSTEMS 


Consider  an  Inventory  manager  who  must  design  a system  of  replenishment 
rules  for  the  stockage  of  possibly  thousands  of  items.  Assume  that  the 
manager  knows  the  costs  of  holding  Inventory,  making  replenishment  decisions, 
revising  the  stock  status  of  an  Item,  etc.,  and  Is  able  to  attach  a cost 
to  each  unit  of  demand  that  cannot  be  filled.  Provided  that  the  relevant 
operating  characteristics  for  each  system  can  be  obtained,  and  that  he 
has  a preference  ordering,  the  Inventory  manager  Is  able  to  determine  whether 
one  system  Is  better  than  another. 

In  designing  the  system,  the  manager  must  select  a class  of  decision 
rules,  and  preferably  pick  optimal  policies  from  the  selected  class.  For 
example,  the  complete  economic  preference  function  of  the  manager  may  Imply 
that  If  the  probability  distribution  of  demand  Is  known,  then  the  optimal 
policy  Is  of  an  (s,S)  form:  when  Inventory  on  hand  plus  on  order  falls  be- 
low s,  place  an  order  so  that  Inventory  on  hand  plus  on  order  Is  S.  However, 
It  will  often  be  the  case  that  the  manager  faces  considerable  uncertainty 
about  the  underlying  demand  distribution.  Consequently,  a decision  process 
for  systems  design  becomes  much  more  complex  than  the  mere  selection  of 
values  for  (s,S). 

First,  If  the  manager  suspects  a non-statlonary  demand  environment, 
he  must  decide  how  much  past  demand  data  to  actually  use  In  updating  the 
replenishment  policy  parameters  and  how  often  these  revisions  should  be 
made.  Second,  the  manager  must  either  guess  at  the  form  of  the  demand 
distribution,  statistically  estimate  the  distribution's  parameters,  and 
then  compute  optimal  policies  for  that  distribution,  or  he  can  choose  an 
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"approximately  optimal"  form  for  the  replenishment  policy  that  depends  on 
only  a few  demand  parameters,  such  as  the  mean  and  variance.  Third,  the 
manager  must  decide,  before  implementing  the  system,  whether  the  design 
parameters  are  well  set.  To  accomnlish  this  task,  the  manager  will  need 
to  predict  the  system's  performance  by  forecasting  the  values  of  key  op- 
erating characteristics.  Usually,  the  manager  will  employ  the  same  de- 
mands for  forecasting  as  well  as  for  policy  derivations.  This  double  use 
of  the  demand  data,  however,  leads  to  biased  forecasts.  To  eliminate 
this  bias,  the  manager  might  consider  splitting  the  demand  sample  in  half; 
using  one  half  of  the  sample  to  update  the  policy  parameters,  and  the 
other  half  to  forecast  the  policy's  performance.  However,  the  manager 
will  still  want  to  use  a policy  based  on  the  entire  demand  sample.  Thus, 
before  this  method  can  be  investigated,  we  need  an  understanding  of  the 
relationship  between  the  split-sample  forecast  and  the  performance  of  the 
policy  based  on  the  entire  demand  sample.  This  procedure,  along  with 
several  other  forecasting  methods  currently  under  investigation,  is  men- 
tioned as  a topic  for  future  research  in  the  final  section  of  this  report. 

It  is  the  purpose  of  this  study  to  examine  several  alternatives  for 
forecasting  inventory  system  operating  characteristics.  The  methods  we 
consider  fall  into  two  major  categories:  methods  that  use  approximate 
formulae  for  the  operating  characteristics,  examined  in  Section  2,  and 
methods  that  rely  on  simulation  to  estimate  the  characteristics,  examined 


in  Section  3. 
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1.1  The  Model 

Throughout  this  report,  we  deal  with  a single-item  inventory 
model.  It  is  assumed  that  inventory  levels  are  reviewed  periodically, 
and  that  the  demand  for  an  item  is  described  by  a stationary,  discrete- 
time, stochastic  process.  The  demand  sequence,  denoted 
consists  of  independent,  identically  distributed,  non-negative,  integer 
valued  random  variables. 

As  long  as  the  amount  of  stock  on  hand  is  sufficient,  demands  are 
met;  should  a stockout  occur,  however,  the  unsatisfied  demand  is  completely 
backlogged  until  sufficient  replenishments  arrive. 

Items  kept  in  inventory  are  assumed  to  be  conserved,  there  being  no 
losses  by  deterioration,  obsolesence,  or  pilferage;  disposal  is  not  allowed. 
Inventory  on  hand  at  the  end  of  a period  is  the  inventory  from  the  previous 
period  plus  any  replenishment  that  arrives,  less  any  demand.  Negative 
stock-on-hand  represents  the  amount  backlogged.  Replenishments  are  assumed 
to  be  delivered  after  a known  fixed  leadtime  L periods  after  being  ordered. 
The  time  sequence  of  events  in  any  period  is  taken  to  be  order,  delivery, 
demand. 

We  assume  no  time  discounting  of  costs  and  an  unbounded  horizon  over 
which  an  item  is  demanded  and  stocked.  Our  objective  is  to  minimize  ex- 
pected total  cost  per  period. 

The  cost  of  a replenishment  quantity  q , denoted  c(q),  is  assumed 
to  be  of  the  form 


c(q) 


k + cq 
0 


For  q > 0 
For  q = 0 


e 
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where  k is  the  fixed  ordering  cost  and  c is  the  constant  cost  per 
item.  Since  costs  are  not  discounted  and  unfilled  demands  are  completely 
backlogged,  the  constant  unit  cost  c is  not  a factor  in  choosing  a 
minimal  cost  policy,  and  is  hereafter  suppressed. 

Let  i represent  the  inventory-on-hand  at  the  end  of  any  period. 

If  i > 0,  we  assume  that  a holding  cost  proportional  to  i at  unit 
cost  h is  assessed.  If  i < 0,  we  assume  a backlog  penalty  cost  pro- 
portional to  -i  at  unit  cost  p is  charged. 

The  resulting  total  cost  function  is  linear  in  k,  p and  h,  and  we 
can  scale  these  parameters  so  that  the  value  of  the  unit  holding  cost  h 
is  one.  Non-trivial  changes  in  costs  arise  only  with  changes  in  the  ratios 
k/h  and  p/h  . 

1.2  The  Inventory  Replenishment  Policy 

We  postulate  that  control  over  replenishment  in  the  inventory  system 
is  exercised  by  an  (s,S)  policy:  whenever  inventory  x on  hand  and  on 
order  at  the  start  of  a period  drops  below  the  value  s,  an  order  is  placed 
for  a replenishment  of  size  S - x . Given  our  assumptions,  when  the  de- 
mand distribution  and  the  economic  parameters  are  known,  there  is  an  optimal 
policy  that  has  the  (s,S)  form  [Iglehart  (1963a, b),  Veinott  and  Wagner  (1965)]. 
When  the  demand  distribution  is  not  known,  even  though  this  is  the  only 
assumption  relaxed,  an  optimal  policy  may  no  longer  be  of  the  (s,S)  form. 
Nevertheless,  in  this  study  we  use  an  (s,S)  policy  since  it  is  in  popular 
use  in  the  applied  situation  of  incomplete  information. 

For  the  purposes  of  this  study  we  compute  approximately  optimal  (s,S) 


5 


policy  rules  by  way  of  the  Statistical  Power  Approximation  [Ehrhardt  (1976)]. 

The  Power  Approximation  is  an  algorithm  for  computing  approximately 

2 

optimal  values  for  (s,S)  using  only  the  mean  u and  variance  o of 
demand.  The  algorithm  is  executed  as  follows.  Let 

(1)  Dp  = (1.463)p-^®^(k/h)-^^®[(L  + 1)0^]*°^®^ 
and 

s,  = (L  + Dm  + [(L  + l)y]-'^^®(a2/p)-®°^U(z) 

(2)  ' 

^1  = ^1  " % 

where  U(z)  is  given  by 


(3) 


U(z)  = .182/z  + 1.142  - 3.466Z  , 


.364y.  ».498 

j! 


(1  + P/h)[(L  + 


1/2 


If  Dp/u  is  greater  than  1.5,  let  s = s^  and  S = 


(4)  S.  = (L  + Du  + v[(L  + l)o^]^/^  . 


Otherwise,  compute 


where  v Is  the  solution  to 

y 

(5)  exp(-x^/2)dx  = p/(p  + h)  . 

• CO 

The  policy  parameters  are  then  given  by 
s = m1n{s^ , $2) 

(6) 

S = m1n{S^ , $2}  . 

When  demands  are  Integer  valued,  s^,  D^,  and  S2  are  rounded  to  the 
nearest  Integer. 

The  Power  Approximation  assumes  that  the  mean  and  variance  of  demand 

are  known.  For  the  more  realistic  situation  in  which  only  sample  statistics 

of  previous  demands  are  available  to  the  decision  maker,  the  policy  parameters, 

s and  S,  can  be  obtained  by  the  Statistical  Power  Approximation,  which 

is  simply  the  Power  Approximation  with  sample  estimates  for  the  mean  and 

2 

variance  of  demand  substituted  for  n and  o In  equations  (1)  through  (6). 

If  the  underlying  demand  sequence  Is  stationary  the  entire  demand 
history  should  be  accumulated  to  yield  progressively  better  performance; 
however,  the  Inventory  manager  Is  not  In  a position  to  know  that  the  con- 
ditions observed  to  date  will  continue  to  prevail.  For  this  reason  the 
policy  parameters  are  periodically  revised. 

For  our  study  the  admittedly  arbitrary  choice  has  been  made  to  keep  a 
history  of  fixed  length  and  to  give  equal  weight  to  all  observations  In  this 
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history.  Let  T be  the  length  of  the  revision  Interval;  that  Is,  the 
number  of  periods  between  revisions.  Assume  that  a history  of  T 
periods'  demand  Is  kept  for  use  at  each  revision.  If  t Is  a period 
at  the  beginning  of  which  a revision  Is  made,  then 

- -1  T 

't-x 

(7)  and 

7 = (T  - 1 )■'  I (5,.,  - ?)^ 

are,  respectively,  the  sample  estimates  for  the  demand  mean  y and 
2 

variance  a required  by  our  decision  rules.  Thus  when  using  the 
Statistical  Power  Approximation  we  periodically  obtain  values  for  (s,S) 
by  substituting  c and  v for  y and  a In  equations  (1)  through  (6). 

1 .3  Forecasting  the  Performance  of  Inventory  Systems  Under  Statistical 
Control  Policies 

In  our  study  we  are  Interested  In  predicting  system  performance  by 
examining  forecasts  of  key  operating  characteristics.  These  system  operating 
characteristics  are:  period-end  holding  quantity,  period-end  backlog  quantity, 
frequency  of  period-end  backlogs,  frequency  of  replenishment,  and  total  cost. 

Consider  a system  In  which  the  control  parameters  are  revised  periodically. 
At  the  beginning  of  each  revision  Interval  the  control  parameters  (s,S) 
are  revised  and  a forecast  f Is  made  of  the  mean  value  of  each  operating 
characteristic  over  the  revision  Interval.  Let  a be  the  actual  realization 
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of  the  mean  operating  characteristic.  If  the  process  continues  over  an 
infinite  horizon,  statistical  equilibrium  will  be  established  and  the 
random  variables  f and  a will  be  identically  distributed,  though 
correlated,  from  one  period  to  the  next. 

We  characterize  the  quality  of  the  forecasting  method  by  its  bias  B, 
defined  as 

(8)  B = E(a  - f) 

and  by  its  level  of  dispersion  D,  where 

(9)  0 = [Var(a  - f)]^^^  . 

Note  that  our  definition  of  bias  is  the  negative  of  the  definition  usually 
given  for  bias,  since  our  biases  run  in  this  direction. 

In  our  study  we  estimate  B and  D for  a given  forecasting  method 
from  the  output  of  a computer  simulation.  Let  f^  and  a^  be,  respectively, 
the  forecast  and  actual  operating  characteristics  in  revision  interval  i 
of  the  simulation  experiment.  Simulated  data  are  collected  for  200  consecutive 
revision  intervals.  The  sample  mean  m and  sample  variance  v of  the 
quantity  (a^  - f^)  are  constructed  using  an  autoregressive  representation 
of  the  time  series  {(a^  - f^),  i »!,...,  200}  . We  construct  estimates 
b and  d of  the  quantities  B and  D , respectively,  where 

b = m. 


Our  objective  Is  to  obtain  a forecasting  procedure  which  produces 


forecasts  with  biases  which  are  close  to  zero  and  whose  level  of  dispersion 
is  low. 

1 .4  Forecasts  by  Retrospective  Simulation 

Previous  forecasting  studies  [MacCormick  (1974),  Estey  and  Kaufinan  (1975), 
and  Ehrhardt  (1976)]  have  utilized  a method  called  "retrospective  simulation". 
This  method  entails  using  the  same  sample  of  demands  both  to  set  the  policy 
parameters  (s,S),  and  to  forecast  the  system's  performance  by  simulating 
how  the  policy  would  have  performed  on  these  demands.  For  a complete  de- 
scription of  this  procedure  see  MacCormick  (1974).  As  a result  of  this 
double  demand  usage,  forecasts  by  retrospective  simulation  are  biased  towards 
lower  total  cost. 

The  purpose  of  this  report  is  to  investigate  the  performance  of  other 
forecasting  techniques  designed  to  decrease  prediction  bias  and/or  dispersion. 
The  forecasting  performance  of  the  retrospective  simulation  method  will  be 
used  as  a bench-mark  to  gauge  improvements  obtained  by  other  methods. 

1 .5  Experimental  Design 

In  our  statistical  policy  simulations  we  have  chosen  to  examine  a 
16-item  system  with  the  parameter  settings  of  Table  1.1  . The  system  is 
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a subset  of  the  72-1  tern  negative  binomial  system  used  In  previous  studies 
[Ehrhardt  (1976),  MacCormlck  (1974)].  We  have  chosen  to  examine  only  those 
Items  with  the  highest  variance-to-mean  ratio  and  shortest  revision  Interval 
since  these  parameter  settings  produced  the  largest  forecast  biases  In  those 
studies. 

TABLE  1.1 
SYSTEM  PARAMETERS 


Factor 

Levels 

Number  of  Levels 

In  Each  System 

Demand  Distribution 

Negative  Binomial 
(a^/u  = 9) 

1 

Mean  Demand,  ^ 

2,  8 

2 

Unit  Holding  Cost,  h 

1 

1 

Unit  Backlog  Penalty  Cost,  p 

4,  99 

2 

Replenishment  Setup  Cost,  k 

32,  64 

2 

Replenishment  Leadtime,  L 

0,  4 

2 

Revision  Interval 

13 



1 

In  this  study  we  discuss  forecasts  of  system-wide  operating  characteristics, 


and  of  Individual  item  characteristics.  System  characteristics  are  defined  as 
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the  sum  of  the  individual  characteristics  for  holding  quantity,  backlog 
quantity,  and  total  cost,  and  as  the  average  of  the  individual  characteristics 
for  replenishment  frequency  and  backlog  frequency. 

The  performance  of  the  retrospective  simulation  forecasting  method  on 
our  16-item  inventory  system  is  summarized  in  Table  1.2  . Notice  that,  on 
the  average,  forecasts  underestimate  each  average  operating  characteristic 
value.  The  forecasts  of  holding  quantity  and  replenishment  frequency  incur 
small  percentage  errors;  however,  backlog  quantity,  backlog  frequency,  and 
total  cost  have  percentage  errors  of  46.7%,  23.3%,  and  29.9%  respectively. 

Most  of  the  bias  in  forecasting  total  cost  is  due  to  the  extreme  under- 
estimation of  backlog  quantity. 

Single-item  data  appear  in  Appendix  A.  Notice  that  in  forecasting 
backlog  quantity  and  backlog  frequency  the  largest  forecasting  errors  occur 
for  those  items  with  a high  penalty  cost.  This  is  due  to  the  fact  that  a 
high  penalty  cost  will  cause  the  policy  parameters  to  be  set  in  such  a way 
that  backlogs  are  rare  events.  Forecasting  the  occurrence  of  these  rare 
events  is  difficult,  especially  when  using  retrospective  simulation  which 
uses  the  same  demands  to  set  the  policy  parameters  and  again  to  forecast 
the  system  performance.  In  fact  for  several  items  with  high  penalty  costs 
no  backlogs  were  ever  predicted.  In  forecasting  total  cost  note  that,  in 
addition  to  high  penalty  cost  items,  those  items  with  small  means  have 
higher  forecasting  biases.  The  level  of  dispersion  in  the  bias  for  fore- 
casting total  cost  is  higher  for  those  items  with  high  penalty  costs  and 
large  means. 
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2.  FORECASTING  BY  APPROXIMATE  EXPRESSIONS  FOR  OPERATING  CHARACTERISTICS 

Ehrhardt  (1977)  developed  a number  of  expressions  that  give  approximate 
values  for  the  following  operating  characteristics  of  (s,S)  inventory  systems: 

I 

H = average  holding  cost  per  period 
B = average  backlog  cost  per  period 

(10)  P = backlog  protection,  i.e.,  frequency  of  periods  without  backlogs 
R = average  replenishment  cost  per  period 
T = average  total  cost  per  period  . 

The  approximations  were  derived  by  using  least-squares  regression  to 
fit  the  parameters  of  functions  to  the  operating  characteristics  of  a large 
number  of  parameter  settings.  These  approximations  are  functions  of  only 
the  economic  parameters,  the  policy  parameters,  and  the  mean  and  variance 
of  demand.  They  are  accurate  to  within  a few  percentage  points  of  the  actual 
values. 

In  this  section  we  forecast  average  operating  characteristic  values 

by  using  these  formulas  with  the  sample  mean  7 » and  the  sample  variance  7 

of  the  previous  demand  history  substituted  for  the  unknown  mean  u and 
2 

variance  a of  the  demand  distribution. 

2.1  Forecasts  Using  Analytical  Approximations  of  Operating  Characteristics 
Approximations  to  the  exact,  analytical  expressions  for  the  operating 
characteristics  of  fixed,  infinite-horizon  (s,S)  policies  were  developed  by 
Ehrhardt  (1977).  He  approximated  these  exact  expressions  with  simplified 
functions  and  then  fit  their  parameter  values  to  the  observed  characteristics 
of  576  Items  using  least-squares  regression.  In  using  these  approximations 
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. for  forecasting  purposes  ■•e  acknowledge  that  the  approximations  were 

derived  for  infinite-horizon  fixed  policies  and  assume  a known  mean  and 
variance  of  demand.  Neither  situation  exists  in  our  model;  however,  it 
was  hoped  that  the  approximations  were  robust  enough  to  produce  accurate 
forecasts. 

We  employ  the  following  approximation  formulas  from  Ehrhardt  (1977) 
to  forecast  average  values  of  the  Power  Approximation  operating  character 
istics  in  (10): 

H = h(W  - .1512u  + .1684a^/u  + .0689) 

P = rG(S|o,  3)  + [(1  - r)/D]{SG(S|o,  3)  - sG(sia.  3) 

- a3G(S|a  +1,  3)  + a3G(s|a  + 1,  3)} 

R = kii/(1  .003D  + .4942p  + .4990a^/u  - .5339) 

T = hd.llOW  + .32740  + .4476^^  - .2234) 

+ p(-.001049W  + .003062o^/u)  + .3364rk 

where 

0 = S - s 

r = u/(1.003D  + .4942y  + .4990a^/u  - .5339) 

W = r[SG(S|a,  3)  - a3G(S|a  +1,  3)] 

I + [(1  - r)/2D]{x^G(x|a,  3)  - 2a3xG(x|o  +1,3) 

? S 

+ (a  + l)a3  G(x|a  + 2,  3)}|s 

1 

I 

1 

1 

!■ 

t 
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G(x|o,  3)  = 


A 

1 [r(ot)6“]“^  / y“"^exp(-ylB)dy  . 

0 


ct  = (L  + 1 )p^/o^ 


3 = a /m 


Due  to  the  complexity  of  evaluating  the  function  G(xlo,  3) 
expressions  for  W and  P , we  used  the  alternatives 


W = r[SN{SQ)  - ct3N(S^)]  + C(1  - r)/2D]  [S^N(Sq) 
- 2a3SN(S^)  + (a  + l)a3^N(S2)  - s^N(Sq) 

+ 2a3sN(s^)  - (a  + 1)(x3^N(s2)] 


and 


P'  = rNCSjj)  + [(1  - r)/D]{SN(SQ)  - sN(Sq)  - a3N(S^ ) + 

where  N(*)  is  the  unit  Normal  Distribution  function  and 

= [S  - (a  + i)3]/[(a  + i)3^]^'^^ 
s^  = [s  - (o  + i)3]/[(o  + i)3^]^'^^  . 


X > 0 

X s 0 

in  the 


a3N(s^)} 
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Because  Ehrhardt's  approximations  for  average  backlog  cost  per  period  B 
are  inaccurate,  we  used  the  relation  B = T - H - R for  our  forecasts. 

We  convert  the  above  operating  characteristics  to  ours  by  employing  the 
following  identities: 

average  holding  quantity  per  period 
average  backlog  quantity  per  period 
backlog  frequency 
replenishment  frequency 

In  Table  2.1  we  summarize  the  accuracy  of  this  forecasting  technique. 

All  of  the  operating  characteristics  were  underestimated  with  the  exception 
of  replenishment  frequency.  In  comparison  with  the  retrospective  simulation 
results.  Table  1.2,  we  observe  that  the  prediction  bias  has  been  reduced 
substantially  in  backlog  quantity,  from  46.7%  to  29.1%,  and  in  backlog 
frequency,  from  23.3%  to  8.4%.  A slight  reduction  in  bias  is  also  evident 
in  forecasting  total  cost.  However,  bias  in  forecasting  holding  quantity 
has  increased  from  1.6%  to  12%,  and  its  level  of  dispersion  has  also  increased 
from  27  to  31.  The  bias  dispersion  levels  for  the  remaining  operating 
characteristics  are  essentially  the  same  as  those  in  the  retrospective 
simulation  forecasts. 

Single  item  data  of  the  forecasts  made  using  the  analytical  approximations 
are  given  in  Appendix  B.  As  mentioned  above,  bias  in  forecasting  holding 
quantity  increased.  The  increased  bias  is  particularly  evident  for  those 
items  with  low  means  and  high  lead  times.  As  before,  items  with  high  penalty 


= H 
= B/p 
= 1 - P 
= R/k  . 
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costs  experienced  the  largest  percentage  errors  in  forecasting  backlog 
quantity  and  total  cost.  For  these  same  operating  characteristics,  pre- 
diction bias  is  even  greater  for  those  items  with  low  mean  values. 

2.2  Forecasts  Using  Multiplicative  Approximations  of  Operating  Characteristics 
Approximate  expressions  of  system  operating  characteristics  based  on 
multiplicative  functional  forms  were  derived  by  Ehrhardt  (1977).  The 
parameters  of  the  functions  were  fit  to  the  observed  characteristics  of  a 
large  multi-item  inventory  system.  These  approximations  are  much  easier  to 
evaluate  and  interpret  than  the  analytical  approximations  discussed  in 
Section  2.1.  We  considered  two  sets  of  approximations;  one  set  derived  for 
fixed  policies  and  the  other  for  statistical  policies. 

2.2.1  Multiplicative  Approximations  for  Fixed  Policies 

In  this  section  forecasts  were  made  by  multiplicative  approximations 
for  fixed  power  approximation  policy  operating  characteristics.  These 
approximations  suffer  from  the  same  limitations  as  the  analytic  approximations, 
in  that  they  assume  an  infinite-horizon  constant  policy  and  a known  mean  and 
variance  of  the  demand  distribution.  We  use  the  following  expressions  from 
Ehrhardt  (1977)  for  the  operating  characteristics  in  (10) 

H = 2.598h  exp(.1204a^/M)M*^°^®  " *004964(7^/11 
^ ^j.2287  + .01472a^/p  - .0900p/a^ 

(p/h)-3.040h/p  + .01137a^/p  - .07292p/a^  + .03355 

(k/h)-3057  - .02667a^/p  + .03058p/a^ 
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P/h) 

- .003856ij/a^  ? 

3 


! 
J 

i 

I 

B = T - H - R . I 

! 

j 

Table  2.2  summarizes  the  forecasting  performance  of  these  approximations. 

i 

1 

As  with  the  analytical  approximation  method,  all  the  operating  characteristics  j 

i 

were  underestimated  with  the  exception  of  replenishment  frequency.  In  i 

1 

comparison  with  the  retrospective  simulation  method.  Table  1.2,  we  discover  j 

i 

a reduction  in  the  percentage  forecasting  error  for  backlog  quantity,  backlog  \ 

frequency,  and  total  cost  of  6.2%,  11.6%,  and  4.4%  respectively.  The  reductions 
are  smaller  than  those  obtained  by  the  analytical  approximations.  Table  2.1. 

The  difference  is  most  noticeable  in  forecasting  backlog  quantities  for 
which  the  analytical  approximations  achieved  a 17.6%  reduction.  Although 
the  multiplicative  approximation  procedure's  bias  in  forecasting  holding 
quantity  was  less  than  that  of  the  analytical  approximations,  7%  as  compared 
to  12%,  the  level  of  dispersion  in  the  bias  was  almost  double.  Levels  of 
dispersion  for  the  other  operating  characteristics  are  similar  to  those 


P = 49.74(p/h)‘^*^^^^/Pexp(.01041p/h)/(l  + 

R ^ .5763h(c2/„)-2”\-‘'’«  * 

^ j-.05744^l^^jjj.6046  - .06563ii/a^ 

T * 2.438h(»2/„)-’“6„.4964  - .005209»2/„ 
(p/h)"‘9230h/P  + .01508a^/M 

+ ^j.l498  + .01231a^/p  - .07050u/a^ 

(k/h)*3095  - .01310a^/u  + .1073ii/o^ 
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obtained  by  the  previous  methods. 

Appenf'^x  C gives  the  Individual  Item  data  of  forecasts  made  by  the 
fixed-policy  multiplicative  approximation  method.  Notice  that  the  fore- 
casts of  backlog  quantity  for  every  Item  were  below  the  actual  realizations 
and,  as  before,  those  Items  with  large  penalty  costs  had  the  highest  per- 
centage differences.  For  each  operating  characteristic  the  forecasts 
for  those  Items  with  low  means,  long  leadtimes,  and  high  penalty  costs 
had  the  largest  percentage  forecasting  errors. 

2.2.2  Multiplicative  Approximations  for  Statistical  Policies 

Ehrhardt  also  derived  multiplicative  approximations  for  the  operating 
characteristics  of  the  Statistical  Power  Approximation.  The  approximations 
were  derived  only  frr  multi-item  systems  having  fixed  varlance-to-mean 
ratios,  so  using  these  expressions  Is  tantamount  to  assuming  that  the 
varlance-to-mean  ratio  Is  known  with  certainty.  This  approach  avoids  the 
shortcomings  of  the  others  In  that  the  approximations  were  derived  for 
statistical  policies  but  they  still  require  the  substitution  of  our  statistical 
estimate  of  mean  demand  In  place  of  the  actual  mean. 

We  used  the  following  approximations  for  the  characteristics  in  (10). 

The  expressions  require  a varlance-to-mean  ratio  of  9 and  a 13-per1od  re- 
vision Interval. 

H = 10.76hw'^^^^(L  + l)’^^®^(p/h)'^’®'^^^P(k/h)*^°^® 

R i .2676hu*®®®®(L  + 1 


(-.0057  + .9853p/h)  / (1  + p/h) 


P ± 


T i 3.776hu-^^®^(L  + 1 ) •^^'^®(p/h)  k/h) 


B = T - H - R 


A summary  of  the  results  of  forecasting  system  performance  using  these 
approximations  appears  in  Table  2.3.  The  results  clearly  demonstrate 
how  accurate  these  approximations  are  when  only  an  estimate  of  the  mean 
demand  is  required.  Backlog  quantity,  backlog  frequency,  and  total  cost 
are  forecasted  with  prediction  errors  of  4.8,  6.0,  and  3.8  percent 
respectively,  compared  with  46.6,  23.3,  and  29.9  percent  prediction  errors 
of  the  same  operating  characteristics  when  forecasting  by  retrospective 
simulation.  With  the  exception  of  holding  quantity,  the  levels  of  bias 
dispersion  for  the  remaining  operating  characteristics  were  slightly  less 
than  those  obtained  by  retrospective  simulation.  Note  also  that  both  back- 
log quantity  and  backlog  frequency  were  overestimated.  This  contrasts 
with  the  severe  underestimation  present  when  retrospective  simulation  or 
the  previous  approximation  formulas  are  used. 

Single-item  data  appear  in  Appendix  D.  The  most  severe  biases  in 
forecasting  total  cost  are  for  those  items  with  low  means  and  high  penalty 
costs.  The  highest  levels  of  bias  dispersion  are  for  those  items  with  large 
penalty  cost  parameters. 

Although  the  forecasts  in  this  section  are  accurate,  it  must  be 
remembered  that  we  have  assumed  a knowledge  of  the  variance-to-mean  ratio. 
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a situation  one  will  not  encounter  in  practice.  It  is  clear  that  great 
forecasting  improvements  can  be  made  if  estimates  of  demand  variance  are 
improved. 

The  results  suggest  that  it  may  be  promising  to  investigate  operating 
characteristic  formulas  for  statistical  policies  that  include  the  variance- 
to-mean  ratio  as  a variable  if  and  when  these  formulas  are  derived. 


I 
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3.  FORECASTING  BY  A FUTURE  DEMAND  GENERATION  TECHNIQUE 

The  bias  In  the  forecasts  produced  by  the  retrospective  simulation 
procedure  can  be  attributed  mainly  to  the  double  use  of  the  demand  Infor- 
mation; once  to  fix  the  policy  parameters  (s,S)  and  then  again  to  predict 
the  system's  performance.  In  this  section  we  examine  a forecasting  pro- 
cedure which  differs  from  the  retrospective  simulation  method  In  that.  In 
stead  of  subjecting  the  policy  parameters  to  the  previous  demand  history, 
we  subject  them  to  a sequence  of  forecasted  demands. 

The  sequence  of  forecasted  demands  consists  of  n Independent  de- 
mands randomly  generated  from  a postulated  demand  distribution  whose 
parameters  are  estimated  from  the  sample  statistics  of  the  previous  de- 
mand history.  An  average  value  for  each  of  the  system's  operating 
characteristics  Is  then  obtained  by  exposing  the  newly  revised  policy  to 
the  forecasted  demand  sequence.  This  entire  procedure  Is  repeated  until 
we  have  accumulated  m simulated  values  for  each  operating  characteristic. 
The  forecasted  value  of  each  operating  characteristic  Is  taken  as  the 
average  of  the  m predictions.  We  shall  refer  to  m as  the  number  of 
replications.  Note  that  although  we  have  eliminated  the  explicit  sequence 
of  previous  demands  In  our  forecasting  simulations,  the  method  still 
requires  a double  use  of  demand  Information:  once  to  set  the  policy 
parameters,  and  then  to  estimate  the  simulated  demand  parameters. 

Recall  that  In  our  experiments  the  underlying  demand  distribution 


Is  negative  binomial  with  a varlance-to-mean  ratio  of  9.  For  this 
reason,  we  examined  the  future  demand  generation  forecasting  technique 
with  postulated  demand  distributions 


1)  negative  binomial  (Section  3.1) 
and 

2)  gamma  (Section  3.2)  . 

The  gamma  was  chosen  because  it  is  the  continuous  analogue  of  the  negative 
binomial  distribution.  By  postulating  a specific  form  of  the  demand 
distribution,  serious  forecasting  errors  may  result  if,  in  fact,  the 
underlying  demand  distribution  is  grossly  different.  In  our  investigation 
of  the  future  demand  generation  technique,  we  did  not  address  this  issue. 
Nonetheless,  it  may  be  worthwhile  to  investigate  the  technique's  robustness. 


3.1  Forecasts  by  Future  Demand  Generation  with  a Postulated  Negative 
Binomial  Demand  Distribution 

Let  ♦(?),  c = 0,  1,2,  ...,  be  the  probability  distribution  of  demand 
per  period.  The  mathematical  form  of  the  negative  binomial  distribution  is 


<*>(5)  = 


A - 1 * c 
\ r - 1 


p+q=l,  p,  qsO 


2 2 

with  expected  value  u = rp/q  , variance  a = rp/q  and  variance-to-mean 
2 

ratio  a /p  = 1/q  . 

We  utilize  the  method  of  moments  to  estimate  the  parameters  p and  r. 
If  t is  the  first  period  in  a revision  interval  and  5^  j 

is  the  previous  demand  history,  we  calculate  the  solutions  p,  r of 
the  equations 

(li)  C = r p/(l  - p)  and  v = r p/(l  - p) 


I 
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where  5 and  v are  the  sample  mean  and  variance,  defined  in  (7)  . 

, A A 

We  solve  for  p and  r to  obtain 

(12)  p = 1 - 7/7  and  r = 7^/(7  - 7)  . 

Forecasts  are  made  by  subjecting  the  revised  policy  to  a sequence 
of  n demands  generated  from  a negative  binomial  distribution  with 

A A 

parameters  p and  r . To  be  consistent  with  previous  results,  the 
value  of  T chosen  was  13,  i.e.,  only  the  13  most  recent  demands  were 

A A 

employed  in  computing  p and  r . 

Before  an  assessment  of  the  forecasting  accuracy  of  this  method  can 
be  made,  the  size  of  the  generated  demand  sequence  n,  and  the  number  of 
replications  m must  be  set. 

Table  3.1  was  constructed  to  demonstrate  the  sensitivity  of  the  bias 
to  the  value  of  n . As  n increases  we  note  a decrease  in  the  bias  of 
forecasts  of  backlog  quantity,  backlog  frequency,  and  replenishment 
frequency,  together  with  a reduction  in  the  bias  dispersion  for  each 
operating  characteristic.  In  particular,  the  dispersion  of  the  bias 
for  total  cost  was  reduced  by  roughly  30%  when  n was  increased  from  13 
to  100.  However,  increasing  n also  results  in  an  enormous  increase  in 
the  bias  of  holding  quantity  forecasts,  with  a corresponding  rise  in  the 
bias  for  total  cost.  This  increase  is  due  to  less  significant  transient 
effects  when  the  policy  is  operated  over  a prolonged  interval.  To  illustrate, 
let  y be  the  inventory  on  hand  at  the  end  of  any  period  and  suppose 
that  upon  revision  of  (s,S)  to  values,  say  (s', S'),  y is  greater  than  S'. 
Let  k be  the  number  of  periods  that  y is  above  S',  and  note  that 


j 


TABLE  3.1 


once  y falls  below  S'  It  will  not  exceed  S'  In  any  of  the  following 
periods.  As  the  ratio  of  k to  the  number  of  periods  that  (s', S')  Is 
in  effect  decreases,  the  effect  of  those  k periods  of  high  Inventory 
levels  on  the  average  Inventory  level  is  decreased.  Hence,  Increasing  n 
leads  to  underestimation  of  actual  holding  quantities.  Because  of  this 
degradation,  n was  set  equal  to  the  revision  Interval  length  (13  periods). 

The  effect  of  Increasing  the  number  of  replications  on  prediction 
bias  Is  shown  In  Table  3.2.  Observe  that  Increasing  m from  one  to  eight 
results  In  a substantial  decrease  In  bias  dispersion  with  only  a minor 
change  In  the  percentage  forecasting  bias  for  each  operating  characteristic. 
Further  increasing  m shows  only  a slight  decrease  in  bias  dispersion 
and.  In  fact,  a small  Increase  In  prediction  bias. 

We  summarize  In  Table  3.3  the  system  performance  of  the  future  demand 
generation  forecasting  method  with  n and  m equal  to  13  and  8,  respectively. 
Notice  that  the  forecast  of  holding  quantity  Is  extremely  accurate,  however, 
as  with  preceding  methods,  forecasts  of  backlog  frequency,  backlog  quantity 
(and  thus  total  cost),  have  large  biases.  In  comparison  with  the  retrospective 
simulation  technique  we  observe  a smaller  prediction  bias  for  every  operating 
characteristic.  Bias  dispersion  levels  are  approximately  the  same  for  both 
procedures . 

Appendix  E contains  the  single-item  forecasting  data.  Note  that  on  the 
average  forecasts  of  backlog  quantity  were  below  the  average  actual  realizations 
for  every  Item.  As  before,  percentage  forecasting  errors  of  backlog  quantity, 
backlog  frequency,  and  total  cost,  tend  to  Increase  with  Increases  In  the 
penalty  cost  and  the  leadtime,  and  with  decreases  In  the  mean. 

Much  of  the  bias  In  the  forecasts  produced  by  the  future  demand 
generation  forecasting  procedure  Is  the  outgrowth  of  a double  use  of  the 


TABLE  3.2 
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demand  statistics;  the  same  statistics  being  used  to  fix  the  policy 
parameters  (s,S)  and  to  estimate  demand  distribution  parameters.  This 
demand  usage  is  less  direct  than  that  employed  by  retrospective  simulation, 
and  as  a result  forecast  bias  is  reduced. 

3.1.1  Future  Demand  Generation  Forecasting  Technique  Using  Variable 
Means  and  Variances 

In  Section  3.1  it  was  pointed  out  that  the  future  demand  generation 
technique  produced  biased  forecasts,  although  less  biased  than  those  ob- 
tained with  retrospective  simulation.  In  this  section  we  discuss  a sampling 
procedure  designed  to  further  reduce  the  undesirable  side  effects  caused 
by  double  use  of  demand  information. 

We  explicitly  acknowledge  the  uncertainty  about  the  demand  distribution 
parameters  by  estimating  their  probability  distributions  and  then  sampling 
from  these  distributions  to  obtain  estimates  of  the  parameters  of  the  demand 
distribution.  The  estimated  parameters  are  then  used  to  generate  a sequence 
of  forecasted  demands. 

We  construct  an  approximate  probability  distribution  for  the  demand 
mean  p by  noting  that  the  sample  mean  x of  a sequence  of  n independent. 
Identically  distributed  random  variables  has  an  asymptotic  normal  dis- 
tribution. Hence,  we  sample  for  p from  a normal  distribution  with  mean 
J and  variance  v/n,  where  T and  7 are  as  defined  in  (7).  Asymptotic 
theory  also  tells  us  that  if  we  assume  5 and  v are  independent,  then  the 

distribution  of  v will  approach  a chi-square  distribution  as  n increases. 

2 

Thus,  we  sample  for  the  demand  variance  a from  a chi-square  distribution 
with  n - 1 degrees  of  freedom. 
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For  each  replication  s of  the  future  demand  generation  technique  we 

use  the  above  sampling  procedure  to  obtain  estimates  and  of  the 

mean  and  variance  of  the  demand  distribution.  Our  forecasted  demand  sequence 

is  then  generated  from  a negative  binomial  distribution  with  parameters 

p = 1 - and  /(^  “ Therefore,  each  replication  in 

s s s s s s s 

our  forecasting  procedure  uses  demands  generated  from  a probability  dis- 
tribution which  is  itself  generated  from  a postulated  distribution. 

Table  3.4  summarizes  the  forecasting  performance  of  this  method.  In 
comparison  with  the  same  procedure  without  sampling  for  demand  parameters. 
Table  3.3,  we  note  a reduction  in  forecasting  bias  for  all  operating 
characteristics  except  holding  quantity  which  has  increased  slightly.  Of 
particular  importance  is  the  fact  that  the  percentage  underestimation  of 
backlog  quantity  has  been  reduced  from  33.7%  to  22.3%,  and  that  of  backlog 
frequency  from  20.6%  to  15.0%.  These  improvements  are  accompanied  with 
only  a small  increase  in  bias  dispersion. 

Single-item  data  appear  in  Appendix  F.  Sensitivity  to  parameter 
settings  Is  analogous  to  that  observed  without  sampT;ing  for  demand  means 
and  variances. 

3.2  Forecasts  by  Future  Demand  Generation  with  a Postulated  Gamma  Demand 

Distribution 

In  this  section  we  examine  the  forecasting  performance  of  the  future 
demand  generation  technique  when  the  demands  are  generated  from  a Gamma 
distribution  whose  parameters  are  estimated  using  sample  statistics  of  the 
previous  demand  history.  Since  the  gamma  is  a continuous  distribution,  the 
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demands  generated  from  1t  constitute  a sequence  of  nonnegative  real  numbers. 
The  generated  demands  were  not  rounded-off  to  the  nearest  Integer. 

The  gamma  Is  a two- parameter  distribution,  denoted  by  G(a,s),  where 
a and  3 are  positive  and  real.  If  X Is  a random  variable  having  a 
gamma  distribution,  then  the  probability  density  function  of  X Is 


fx(x)  = 


xa-1  g-x/6  / 
0 


0 s X s » 

elsewhere 


2 2 

with  expectation  p = a 3 , variance  a = a 3 , and  variance- to-mean 
ratio  a^/p  = 3 • 

As  was  the  case  for  the  negative  binomial  distribution,  we  use  the 
method  of  moments  to  obtain  estimates  of  the  parameters  a and  3 . Thus, 

If  t Is  the  first  period  of  a revision  Interval  and  

Is  the  previous  demand  history,  we  calculate  the  solutions  a,  § of 
the  equations 


(13)  C = a § and  v = o , 

where  c and  v are  as  defined  In  (7)  . 

Hence 

(14)  0 = ^/7  and  § = 7/J 

Forecasts  are  made  at  the  beginning  of  each  revision  Interval  by 
subjecting  the  revised  control  policies  to  a sequence  of  n Independent 


demands  generated  from  a G(a,  t)  distribution.  In  keeping  with  the 
practice  employed  In  the  other  forecasting  methods,  only  the  13  most 
recent  demands  were  used  In  computing  c and  v . 

A system  performance  summary  of  this  forecasting  method  for  single 
and  multiple  replications  appears  In  Table  3.5.  Notice  that  forecasts  of 
backlog  quantity  and  backlog  frequency  have  negative  biases  which  contrasts 
with  the  positive  biases  produced  by  the  forecasting  methods  discussed 
previously.  Again  we  see  that  increasing  the  number  of  replications  de- 
creases the  dispersion  of  the  bias.  In  particular,  bias  dispersion  for 
backlog  quantity  and  total  cost  has  been  reduced  approximately  30%  by  in- 
creasing m from  1 to  10.  A comparison  of  this  procedure,  using  ten 
replications,  with  the  retrospective  simulation  method  of  forecasting 
gives  several  interesting  observations.  First,  the  percentage  forecasting 
bias  for  backlog  quantity  Is  5.2%  for  this  method  as  compared  with  the 
gross  46. 6X  bias  by  retrospective  simulation  forecasting.  Second,  the 
Improved  forecasts  of  backlog  quantity  lead  to  a smaller  bias  In  fore- 
casting total  cost,  11%  as  compared  with  almost  30%  by  retrospective 
simulation.  Third,  the  dispersions  are  greater,  most  notably  for  the 
total  cost  forecast  which  has  a dispersion  of  185  as  compared  to  117  for 
retrospective  simulation. 

Appendix  G gives  the  Individual -Item  forecasts  using  ten  replications. 
Forecasting  bias  for  total  cost  tends  to  Increase  as  leadtime  and  penalty 
cost  Increase,  and  decrease  as  the  mean  Increases.  Note  also  that  the 
dispersion  of  the  bias  for  total  cost  is  highly  sensitive  to  penalty  cost, 
and  Is  generally  greater  for  those  items  with  a high  setup  cost. 


TABLE  3.5 


TOTAL  COST  806.3 
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The  changes  in  forecasting  performance  resulting  from  the  use  of 
gamma  distribution  in  place  of  the  negative  binomial  are  greater  than  we 
had  expected.  We  can  only  speculate  that  the  continuous  property  of  the 
gamma  distribution  is  responsible. 
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4.  COMPARISON  OF  FORECASTING  PROCEDURES 

In  this  section  we  compare  the  performance  of  the  forecasting 
procedures  discussed  In  the  preceding  sections.  We  also  suggest  topics 
for  future  research. 

4.1  Properties  of  Single-Item  Forecasts 

As  a measure  of  the  deviation  between  forecasted  values  f,  and 
actual  realizations  a,  we  define  the  mean  square  error  of  a single-item 
forecast  as 

MSE  s E(a  - f)^  , 
and  the  root  mean  square  error  as 
RMSE  = vflSE  . 

Using  the  fact  that 

Var(a  - f)  = E(a  - f)^  - [E(a  - f)]^  , 

and  the  definitions  of  bias  B and  dispersion  D given  In  (8)  and  (9), 
we  have 

(15)  MSE  = . 

Hence,  u forecasting  scheme's  MSE  becomes  larger  with  Increases  In  bias 
and/or  dispersion. 

Previous  studies  [Ehrhardt  (1976),  MacCormIck  (1974)]  have  Indicated 
that  for  single-item  forecasts  using  retrospective  simulation,  the  dispersion 
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term  dominates  the  MSE.  In  fact,  the  dispersion  Is  so  large  that 
the  forecasting  method  Is  essentially  useless  for  single  Items.  In  our 
study  we  have  observed  this  phenomenon.  For  not  only  the  retrospective 
simulation  method,  but  for  the  other  methods  Investigated  as  well.  This 
fact  Is  exhibited  by  the  single-item  data  in  Appendices  A through  G. 

In  the  next  section  we  examine  the  Impact  of  dispersion  on  the  MSE 
when  the  single  Item  forecasts  of  each  operating  characteristic  are 
aggregated  in  a multi-item  system. 

4.2  Properties  of  Multi-Item  Forecasts 

In  the  previous  section  we  observed  that  for  single-item  forecasts 
the  dispersion  overwhelms  the  bias,  and  this  was  true  for  each  of  the  fore- 
casting methods  discussed  In  this  study.  However,  we  will  show  that  the 
dispersion  becomes  small  relative  to  the  bias  when  forecasts  are  aggregated 
in  a multi-item  system  containing  a sufficiently  large  number  of  items 
with  Independent  demand  processes. 

To  Illustrate,  consider  a system  consisting  of  n independent  Items. 
Let  b^  and  d^  represent,  respectively,  the  bias  and  dispersion  for 
item  1 . Thus,  when  single-item  forecasts  are  aggregated  over  the  multi - 
Item  system,  the  aggregate  bias  B and  dispersion  D are  given  by 


The  mean  square  error  of  the  multi -Item  forecast  can  be  expressed  as 


41 


If  we  let 

— -1  — -1  2 
(17)  b = n i b.  and  d » n ^ d < » 

1=1  ' i-1  ' 

then  (16)  becomes 

MSE  = n^b^  + nd  . 

We  assume  that  b^  and  d^  are  finite  for  all  1 . Therefore,  we 
observe  that  for  sufficiently  large  values  of  n and  b / 0 , the 
dominant  factor  In  the  MSE  of  a multi-item  forecast  Is  the  bias. 

When  comparing  forecasting  procedures  for  particular  operating 
characteristic  the  above  discussion  suggests  that  the  procedure  which 
exhibits  the  smallest  MSE  In  our  16-Item  system  will  not  necessarily 
have  the  smallest  MSE  for  any  system  size. 

To  Illustrate,  consider  a hypothetical  system  consisting  of  m 
Independent  16-Item  systems,  each  Identical  to  ours.  Suppose  that  In  our 
16-Item  system  forecasting  procedure  A has  bias  and  dispersion  quantities 
b^  and  d^  as  defined  In  (17).  Let  forecasting  procedure  B be 
characterized  by  bias  and  dispersion  quantities  bg  and  dg  , defined 
In  the  same  way.  Further  suppose  that  b^  > bg  and  d^  < 3g  . Then 
for  any  m we  have 

MSE^  - MSEg  = m^(b^^  - 5^g)+  «(d^^  - d^g)  . 
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Let  a = - b^g)  and  6 = - ^g)  . Then 

MSE^  - MSEg  = oon^  + 

is  quadratic  in  m with  roots  at  0 and  at  -B/a  . Thus,  for  every  m 
less  than  m*  = -3/a  method  A will  have  lower  MSE  than  method  B,  and 
method  B will  have  lower  MSE  than  method  A for  every  m greater  than  m*. 
We  can  interpret  m*  as  the  forecasting  system  size  for  which  the  better 
method  changes. 

Tables  4.1  and  4.2  provide  a summary  of  the  performance  of  the  fore- 
casting procedures  disucssed  in  this  study.  The  entries  in  Table  4.1  are 
the  bias,  dispersion  and  root  mean  square  error  of  each  operating  char- 
acteristic forecast,  and  Table  4.2  has  these  same  entries  expressed  as  the 
percentage  of  the  actual  value.  Observe  that  for  holding  quantity  the 
retrospective  simulation  method  has  the  smallest  RMSE,  but  the  future  de- 
mand generation  technique  with  postulated  negative  binomial  demand  distri- 
bution has  the  smallest  bias:  Therefore,  for  sufficiently  large  systems 
the  latter  method  will  dominate.  For  backlog  frequency  the  analytic  ap- 
proximation method  has  the  smallest  bias  and  lowest  dispersion,  and  is, 
therefore,  superior  for  all  system  sizes.  For  backlog  quantity  and  re- 
plenishment frequency  the  analytic  approximation  method  also  has  the  lowest 
RMSE;  however,  the  smallest  biases  for  these  operating  characteristics  are 
produced  by  the  future  demand  generation  method  with  postulated  negative 
binomial  demand  distribution.  We,  therefore,  can  conclude  that  in  larger 
systems  this  method  will  dominate  the  analytic  approximation  technique. 
Finally,  for  total  cost  the  future  demand  generation  technique  with  pos- 
tulated gamma  demand  distribution  has  the  smallest  RMSE,  but  it  has  a 


TABLE  4.1 


Entries  are:  Bias  (Dispersion) 
[RMSE] 


Comparison  of  Forecasting  Methods'  Performance  on  a 16-item  System 
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higher  level  of  dispersion  than  any  of  the  other  methods.  As  a result, 
we  would  expect  one  of  the  other  methods  to  dominate  for  systems  having 
fewer  items. 

In  conclusion,  we  observe  that  no  single  method  is  uniformly 
superior  for  each  operating  characteristics.  The  two  most  promising 
procedures  appear  to  be  the  analytic  approximation  method  and  the  future 
demand  generation  techniques. 

One  additional  issue  that  must  be  considered  in  selecting  a fore- 
casting procedure,  is  its  simplicity  of  implementation.  In  this  respect 
the  analytic  approximations  are  clearly  superior  to  the  future  demand 
generation  techniques.  The  analytic  approximation  method  requires  only 
the  computation  of  a formula  for  each  operating  characteristic.  Although 
these  formulas  are  rather  complicated,  their  evaluation  requires  con- 
siderably less  effort  than  the  future  demand  generation  techniques  which 
require  the  generation  of  many  random  variates  and  the  explicit  simulation 
of  system  behavior. 

4.3  Topics  for  Future  Research 

In  this  section  we  suggest  several  topics  for  future  research  in 
forecasting  operating  characteristic  values. 

Recall  that  in  Section  2.2.2  we  observed  that  the  statistical  policy 
multiplicative  approximations  perform  extremely  well,  but  are  not  applicable 
in  actual  practice  since  they  were  derived  for  a specific  variance-to-mean 
ratio.  Consequently,  it  may  be  promising  to  investigate  statist! cal -policy 
operating  characteristic  formulas  that  include  the  variance-to-mean  ratio 
as  a variable  if  and  when  these  formulas  are  derived. 

Another  possible  avenue  for  future  research  is  the  investigation  of 
alternative  demand  estimation  methods  in  the  future  demand  generation 


technique.  In  our  research  we  have  used  the  method  of  moments.  One  may 
be  able  to  obtain  better  estimates  of  demand  parameters  by  using  other 
methods.  For  example,  in  the  case  of  the  negative  binomial  distribution 
we  might  consider  the  maximum  likelihood  method. 

Further  research  is  also  needed  in  determining  the  robustness  of  the 
future  demand  generation  technique  to  misspecification  of  the  form  of  the 
underlying  demand  distribution. 

A possible  improvement  in  the  forecasting  performance  of  the  retro- 
spective simulation  method  may  lie  in  the  derivation  of  an  analytical 
expression  for  the  bias  in  its  forecasts.  This  expression  could  then  be 
used  as  a correction  factor  for  the  forecasts.  Research  along  this  line 
is  presently  underway. 

Another  possible  extension  of  this  study  could  consider  hybrid  fore- 
casting procedures,  which  would  use  several  methods  of  forecasting  simul- 
taneously. In  principle,  one  could  then  use  the  best  method  for  each 
operating  characteristic  and  also  choose  the  best  combination  of  holding 
cost,  backlog  cost,  and  replenishment  cost  forecasts  to  obtain  a total 
cost  estimate. 

Finally  we  describe  a forecasting  approach  that  was  mentioned  earlier 
in  this  report.  The  method  reduces  the  double-use  of  information  by 
splitting  the  sample  of  demand  observations  in  half.  One  half  of  the 
sample  is  used  to  derive  a policy  rule  while  the  other  half  is  used  to 
forecast  the  policy's  performance.  However,  the  decision-maker  will  want 
to  use  a policy  based  on  the  entire  sample  of  demands.  Therefore,  we  need 
to  understand  the  relationship  between  the  split-sample  forecast  and  the 
performance  of  the  policy  based  on  the  entire  sample.  This  method  is 
presently  under  investigation. 
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